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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )^| Responsive to communication(s) filed on 1 2 December 2008 . 
2a )□ This action is FINAL. 2b)£3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^3 Claim(s) 35,37,38,40-45,47,51 and 113-115 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) |EI Claim(s) 35.37.38.40-45.47.51 and 113-115 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) L~H The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)^ accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)E| All b)D Some * c)D None of: 

1 .^3 Certified copies of the priority documents have been received. 

20 Certified copies of the priority documents have been received in Application No. . 

3.^ Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1 .17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.1 14. Applicant's submission filed on 12 December 2008 has been entered. 



Information Disclosure Statement 

2. The examiner apologizes on behalf of the Office for not providing the considered 1449 
statements earlier as the examiner of record has changed since original submission of these 
statements. While the day-date of the 1449 declarations are slightly different than what applicant 
suggests, the examiner has considered and provided the closest documents to said dates. 

Therefore, the information disclosure statement(s) (IDS) submitted on 24 November 
2004, 20 June 2005 and 06 August 2007 have are in compliance with the provisions of 37 
CFR 1.97. Accordingly, the examiner has considered the information disclosure statement(s). 

Response to Amendment 

3. The Affidavit filed on 12 December 2008 under 37 CFR 1.131 has been considered but is 
ineffective to overcome the Rueda (US Patent No. 6,157,727, 'RUEDA' hereinafter) reference. 

The evidence submitted is insufficient to establish a conception of the invention prior to 
the effective date of the Rueda (US Patent No. 6,157,727) reference. While conception is the 
mental part of the inventive act, it must be capable of proof, such as by demonstrative evidence 
or by a complete disclosure to another. Conception is more than a vague idea of how to solve a 
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problem. The requisite means themselves and their interaction must also be comprehended. See 
Mergenthaler v. Scudder, 1897 CD. 724, 81 O.G. 1417 (D.C. Cir. 1897). All evidentiary 
support documents are presented in what is presumed to be Japanese, which fails to comply with 
language requirements. This makes it impossible for the examiner to review such information to 
support the allegations set forth by applicant in the declaration and is thereby insufficient to 
prove prior conception. 

Further, performing one's duties at a place of employment is not sufficient to provide 
relief of significant gaps in time when proving due diligence. 

Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claims 35, 37-39, 41-45, 47, 51, and 113 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over RUEDA referred to as RUEDA hereinafter in view of Takebayashi et al. 
(5,577,165), 'TAKEBAYASHI' hereinafter. 

Claim 35 : RUEDA teaches a prosthetic hearing device (hearing aid, col. 2 lines 56-60) 
comprising: 

i. a sensor for detecting a speech (microphone, col. 3 lines 1-10); 

ii. a speech recognition processor that performs speech recognition on the detected 
speech (col. 3 lines 23-26); 
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iii. wherein the speech recognition processor performs speech recognition in view of at 
least one of a physical state of the user and an operating condition of the prosthetic hearing 
device (col. 1 lines 53-56); 

iv. an output device (output transducer, Abstract) that outputs generated speech to the 
user and a speech generator (speech recognizer and processor, Fig. 1). 

RUEDA does not teach a speech generator that analyzes results of speech recognition to 
comprehend a semantic meaning in the detected speech and transforms the detected speech into a 
speech having a speech form assistive in understanding the semantic meaning in the detected 
speech. 

However, TAKEBAYASHI does teach a speech generator that analyzes results of 
speech recognition to comprehend a semantic meaning in the detected speech and transforms the 
detected speech into a speech having a speech form assistive in understanding the semantic 
meaning in the detected speech (col. 6 lines 44-50). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement TAKEBAYASHI semantic recognition into RUEDA' s speech generator 
system in order to provide a speech dialogue system for improving human-computer interaction, 
because in conventional speech dialogue system, the speech response is usually given by a 
mechanical voice reading obtained by a text composition without any modulation of speech tone, 
so that it has often been difficult for the user to hear the message, (TAKEBAYASHI, Abstract 
and col. 2 lines 23-34). 
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Claim 37 : RUED A discloses a device as per claim 35 above, further disclosing a speech 
recognition generator processor performs at least one of speaker recognition (speech recognizer 
and processor, Fig. 1). 

RUEDA does not teach a speech generator generates the speech representing results of 
the recognition. 

However, TAKEBAYASHI teaches a speech generator that generates the speech 
representing the results of the recognition (speech understanding unit, col. 8 lines 25-45). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement TAKEBAYASHI into RUEDA's speech generator system in order to 
provide high speech understanding of the almost freely uttered speech by using very little 
restrictions regarding the manner of speech utterance imposed on the user (TAKEBAYASHI, 
Abstract and col. 8 lines 25-30). 

Claim 38 : RUEDA discloses a device as per claim 35 above, further disclosing a 
prosthetic hearing device wherein the speech recognition processor transforms detected speech in 
view of at least one of a an operating condition of the prosthetic hearing device and a purpose for 
use of the device by the user (language translation, Abstract and col. 3 lines 20-29). 

Claim 40 : RUEDA discloses a device as per claim 35 above, further disclosing wherein 
the speech generator transforms the detected speech by adding thereto a modifying language 
(language translation, Abstract). 

Claim 41 : RUEDA discloses a device as per claim 35 above, further disclosing wherein 
the speech generator reproduces a speech previously produced when it determines the results 
from the speech recognition that it is necessary to reproduce the previously produced speech 
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(col. 3 lines 1-10 and 20-27 and col. 1 lines 1-24; necessary storing information, thus able to 
reproduce it via speech generator) 

Claim 42 : RUEDA discloses a device as per claim 35 above, further disclosing wherein 
the speech generator reproduces speech previously produced when it determines from the result 
of the speech recognition that it is necessary to reproduce the previously produced speech (col. 1, 
lines 1-10 and 20-28). 

Claim 43 : RUEDA discloses a device as per claim 35 above, further disclosing wherein 
the speech data generator controls an output rate of the speech data (col. 3 lines 20-28). 

Claim 44 : RUEDA discloses a device as per claim 35 above, further disclosing wherein 
the output device outputs the speech using a sample speech data synthesized by the speech 
generator (col. 3 lines 1-10 and 20-27; necessary in the translating process is a speech 
synthesized from a speech generator). 

Claim 45 : RUEDA discloses a device as per claim 35 above, further disclosing a memory 
that has stored samples of speech data (Abstract, necessary in translating process), wherein the 
output device outputs the sound speech data using sample speech data selected by the speech 
data generator from the memory (col. 3 lines 1-10 and 20-27; necessary in the translating 
process is a memory). 

Claim 47 : RUEDA discloses a device as per claim 35 above, further disclosing the 
speech generator generates the speech that summarizes the detected speech (col. 3 lines 1-10 and 
20-27). 
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Claim 51 : RUEDA discloses a device as per claim 35 above, further disclosing wherein 
the sensor selectively detects a speech necessarily from a specific speech source (col. 1, lines 1 - 
10 and 20-27). 

Claim 113 : RUEDA teaches prosthetic hearing device (hearing aid, col. 1 lines 56-60) 
comprising: 

i. a sensor for detecting a speech (microphone, col. 3 lines 1-10); 

ii. a speech recognition processor that performs speech recognition on the detected 
speech (col. 3 lines 23-26), wherein the speech generator transforms the detected speech in view 
of at least one of a physical state of the user and an operating condition of the prosthetic hearing 
device (col. 3 lines 20-29 and col. 1 lines 52-56, translation purpose) 

iii. an output device (output transducer, Abstract) that outputs generated speech to the 
user a speech generator (speech recognizer and processor, Fig. 1). 

RUEDA does not teach a speech generator that analyzes results of speech recognition to 
comprehend a semantic meaning in the detected speech and transforms the detected speech into a 
speech having a speech form assistive in understanding the semantic meaning in the detected 
speech. 

However, TAKEBAYASHI does teach a speech generator that analyzes results of 
speech recognition to comprehend a semantic meaning in the detected speech and transforms the 
detected speech into a speech having a speech form assistive in understanding the semantic 
meaning in the detected speech (col. 6 lines 44-50). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement TAKEBAYASHI into RUEDA's speech generator system in order to 
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provide a speech dialogue system for improving human-computer interaction, because in 
conventional speech dialogue system, the speech response is usually given by a mechanical voice 
reading obtained by a text composition without any modulation of speech tone, so that it has 
often been difficult for the user to hear the message, (TAKEBAYASHI, Abstract and col. 2 lines 
23-34). 

Claim 114 : RUEDA discloses a device as per claim 35 above, however failing to, but 
TAKEBAYASHI does specifically disclose a memory that has stored a library of images 
compressing still and motion pictures (col. 18 lines 27-37), symbols (text, col. 7 lines 25-38), 
characters (text, col. 7 lines 25-38), notes (text, col. 7 lines 25-38), photos (animated picture, col. 
18 line 33), animations (col. 18 lines 31-34), illustrations (human character image, col. 18 lines 
35-39), voice spectrum patterns (Fig. 3) and colors (col. 25 lines 14-16), wherein the speech 
generator selects at least one image associated with the semantic meaning in the detected speech 
(col. 7 lines 23-3 1 and col. 6 lines 44,-50). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement TAKEBAYASHI into RUEDA's speech generator system in order to 
provide a speech dialogue system for improving human-computer interaction, because in 
conventional speech dialogue system, the speech response is usually given by a mechanical voice 
reading obtained by a text composition without any modulation of speech tone, so that it has 
often been difficult for the user to hear the message, (TAKEBAYASHI, Abstract and col. 2 lines 
23-34). 
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Claim 115 : RUEDA discloses a device as per claim 114 above, however failing to, but 
TAKEBAYASHI does specifically disclose a display that displays the selected at least one 
image associated with the semantic meaning in the detected speech (col. 7 lines 30-37). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to implement TAKEBAYASHI into RUEDA's speech generator system in order to 
provide a speech dialogue system for improving human-computer interaction, because in 
conventional speech dialogue system, the speech response is usually given by a mechanical voice 
reading obtained by a text composition without any modulation of speech tone, so that it has 
often been difficult for the user to hear the message, (TAKEBAYASHI, Abstract and col. 2 lines 
23-34). 



Conclusion 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JUSTIN W. RIDER whose telephone number is (571)270-1068. 
The examiner can normally be reached on Monday - Friday 6:30AM - 3:30PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David R. Hudspeth can be reached on (571) 272-7843. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you 
would like assistance from a USPTO Customer Service Representative or access to the 
automated information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/David R Hudspeth/ 

Supervisory Patent Examiner, Art Unit 2626 

/J. W. R./ 

Examiner, Art Unit 2626 
12 February 2009 



